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Fuzzy Preferences in Multi -Objective Optimization (MOO) 



The present invention relates to a method for the 
5 optimization of multi-objective problems using evolutionary 
algorithms, to the use of such a method for the optimization 
of aerodynamic or hydrodynamic bodies as well as to a 
computer software program product for implementing such a 
method. 

10 

The background of the present invention is the field of 
evolution algorithms. Therefore, with reference to Fig. 1, at 
first the known cycle of an evolutionary algorithm will be 
explained. 

15 

In a step Si, the object parameters to be optimized are 
encoded in a string called 'individual'. A plurality of such 
individuals comprising the initial parent generation is then 
generated and the quality (fitness) of each individual in the 
20 parent generation is evaluated. In a step S2, the parents are 
reproduced by applying genetic operators called mutation and 
recombination. Thus, a new generation is reproduced in step 

53, which is called the offspring generation. The quality of 
the offspring individuals is evaluated using a fitness 

25 function that is the objective of the optimization in step 

54. Finally, depending on the calculated quality value, step 
S5 selects, possibly stochastically, the best offspring 
individuals (survival of the fittest) which are used as 
parents for the next generation cycle if the termination 

30 condition in step S6 is not satisfied. 



Before evaluating the quality of each individual, decoding 
may be needed depending on the encoding scheme used in the 
evolutionary algorithm. It should be noted that the steps S2, 
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S3, S4, S5 and S6 are cyclically repeated until the condition 
for termination of the optimization in step S6 is satisfied. 

The algorithm of this evolutionary optimization can be 
5 expressed by the following pseudo-code: 



t := 0 

encode and initialize P(0) 
decode and evaluate P(0) 
do 

recombine P(t) 
mutate P(t) 
decode P(t) 
evaluate P(t) 
P(t+1) : = select P(t) 
encode P(t+1) 
t := t + 1 
until terminate 



20 Thereby, 



P(0) denotes the initial population size (t = 0), 
P(t) denotes the offspring population size in the t-th 
successor generation (t > 0) , 
25 t is the index for the generation number (t g © 0 ) . 

Such evolutionary algorithms are known to be robust 
optimizers that are well-suited for discontinuous and 
multi-modal objective functions. Therefore, evolutionary 
30 algorithms have successfully been applied e.g. to mechanical 
and aerodynamic optimization problems, including preliminary 
turbine design, turbine blade design, multi-disciplinary 
rotor blade design, multi-disciplinary wing platform design 
and a military airframe preliminary design. 
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Usually, there are two targets in a multi-objective 
optimization: 

(i) finding solutions close to the true Pareto-optimal 
solutions, and 

(ii) finding solutions that are widely different from each 
other . 

The first task is desired to satisfy optimality conditions in 
the obtained solutions. The second task is desired to have no 
bias towards any particular objective function. 

In dealing with multi-objective optimization problems, 
classical search and optimization methods are not efficient, 
simply because 

- most of them cannot find multiple solutions in a single 
run, thereby requiring them to be applied as many times as 
the number of desired Pareto-optimal solutions, 

- multiple application of these methods do not guarantee 
finding widely different Pareto-optimal solutions, and 

- most of them cannot efficiently handle problems with 
discrete variables and problems having multiple optimal 
solutions . 

On the contrary, the studies on evolutionary search 
algorithms, over the past few years, have shown that these 
methods can efficiently be used to eliminate most of the 
difficulties of classical methods mentioned above. Since they 
use a population of solutions in their search, multiple 
Pareto-optimal solutions can, in principle, be found in one 
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For example, details on evolutionary algorithms can be found 
in "Evolutionary Algorithms in Engineering Applications" 
(Springer-Verlag, 1997) by Dasgupta et al . , and "Evolutionary 
5 Algorithms in Engineering and Computer Science" (John Wiley 
and Sons, 1999) by Miettinnen et al. 

In the framework of the present invention, the evolutionary 
algorithms are applied to the simultaneous optimization of 

10 multiple objectives, which is a typical feature of practical 
engineering and design problems. The principle multi- 
objective optimization differs from that in a single-obj ec- 
tive optimization. In single-objective optimization, the 
target is to find the best design solution, which corresponds 

15 to the minimum or maximum value of the objective function. On 
the contrary, in a multi-objective optimization with 
conflicting objectives, there is no single optimal solution. 
The interaction among different objectives gives rise to a 
set of compromise solutions known as the Pareto-optimal 

20 solutions. A definition of 1 Pareto-optimal T and 1 Pareto 
front 1 can be found in "Multi-Objective Evolutionary 
Algorithms: Analyzing the State of the Art" (Evolutionary 
Computation, 8(2), pp. 125-147, 2000) by D.A. Van Veldheizen 
and G . B . Lamont . 

25 

Since none of these Pareto-optimal solutions can be 
identified as better than others without any further 
consideration, the target in a multi-objective optimization 
is to find as many Pareto-optimal solutions as possible. Once 
30 such solutions are found, it usually requires a higher-level 
decisionmaking with other considerations to choose one of 
them for implementation. 
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single run. The use of diversity-preserving mechanisms can be 
added to the evolutionary search algorithms to find widely 
different Pareto-optimal solutions . 

5 A large number of evolutionary multi-objective algorithms 
(EMOA) have been proposed. So far, there are three main 
approaches to evolutionary multi-objective optimization, 
namely, aggregation approaches, population-based non-Pareto 
approaches and Pareto-based approaches. In the recent years, 
10 the Pareto-based approaches have been gaining increasing 
attention in the evolutionary computation community and 
several successful algorithms have been proposed. 
Unfortunately, the Pareto-based approaches are often very 
time-consuming . 

15 

Despite their shortcomings, weighted aggregation approaches 
to multi-objective optimization according to the state of the 
art are very easy to implement and computationally efficient. 
Usually, aggregation approaches can provide only one Pareto- 

20 solution if the weights are fixed using problem-specific 

prior knowledge. However, it is also possible to find more 
than one Pareto solution using this method by changing the 
weights during optimization. The weights of the different 
objectives are encoded in the chromosome to obtain more than 

25 one Pareto solutions. Phenotypic fitness sharing is used to 
keep the diversity of the weight combinations and mating 
restrictions are required so that the algorithm can work 
properly. 

30 It has been found that the shortcomings of the conventional 
aggregation approach can be overcome by systematically 
changing the weights during optimization without any loss of 
simplicity and efficiency. Three methods have been proposed 
to change the weights during optimization to approximate the 

35 Pareto front. The randomly-weighted aggregation (RWA) method 
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distributes the weights uniformly and randomly among the 
individuals within the population and the weights are re- 
distributed in each generation. In contrast, the dynamically- 
weighted aggregation (DWA) method changes the weights 
5 gradually when the evolution proceeds. If the Pareto-optimal 
front is concave, the bang-bang weighted aggregation (BWA) 
can also be used. In order to incorporate preferences, both 
RWA and DWA can be used. 

10 Randomly Weighted Aggregation 

In the framework of evolutionary optimization it is natural 
to take advantage of the population for obtaining multiple 
Pareto-optimal solutions in one run of the optimization. On 
the assumption that the i-th individual in the population has 

15 its own weight combination (wl(t), fc^OO) in generation t, the 

evolutionary algorithm will be able to find different Pareto- 
optimal solutions. To realize this, it can be found that the 
weight combinations need to be distributed uniformly and 
randomly among the individuals, and a re-distribution is 

20 necessary in each generation: 

w s 2 (t) = 1.0 - wi(t), 

25 wherein 

i denotes the i-th individual in the 

population (i = 1, 2,..., P) , 
P is the population size (P e ©) , and 
30 t is the index for the generation number (t e © 0 ) • 

The function rdm (p) generates a uniformly distributed random 
number between 0 and P. In this way, a uniformly distributed 
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random weight combination (w^, w]) among the individuals can 

be obtained, where 0 < w[ , w\ < 1 and w[ + w x 2 = 1 . In this 
context, it should be noted that the weight combinations are 
regenerated in every generation. 

5 

Dynamic Weighted Aggregation 

In the dynamically-weighted aggregation (DWA) approach, all 
individuals have the same weight combination, which is 

10 changed gradually generation by generation. Once the 

individuals reach any point on the Pareto front, the slow 
change of the weights will force the individuals to keep 
moving gradually along the Pareto front if the Pareto front 
is convex. If the Pareto front is concave, the individuals 

15 will still traverse along the Pareto front, however, in a 

different fashion. The change of the weights can. be realized 
as follows: 

w x (t) = | sin (2 nt/F) | , 
20 w 2 (t) =1.0- w x (t). 

where t is the number of generation. Here the sine function 
is used simply because it is a plain periodical function 
between 0 and 1. In this case, the weights w x (p) and w 2 (t) 

25 will change from 0 to 1 periodically from generation to 
I generation. The change frequency can be adjusted by F. The 
frequency should not be too high so that the algorithm is 
able to converge to a solution on the Pareto front. On the 
other hand, it seems reasonable to let the weight change from 

30 0 to 1 at least twice during the whole optimization. 

In the above methods, it is assumed that all objectives are 
of the same importance. In this case, weights are changed 
between [0,1] in RWA and DWA to achieve all Pareto-optimal 
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solutions. However, in many real-world applications, 
different objectives may have different importance. Thus, the 
goal is not to get the whole Pareto front, but only the 
desired part of the Pareto front. The importance of each 
objective is usually specified by the human user in term of 
preferences. For example, for a two-objective problem, the 
user may believe that one objective is more important than 
the other. To achieve the desired Pareto-optimal solutions, 
preferences need to be incorporated into multi-objective 
optimization. Instead of changing the weights between [0,1], 

they are changed between [w rnin , */"*], where 0 ^ w^" < w max < 1, 
are defined by the preferences. Usually, the preferences can 
be incorporated before, during or after optimization. In this 
invention, preference incorporation before optimization is 
concerned. 

As discussed in "Use of Preferences for GA-based Multi- 
Objective Optimization" (Proceedings of 1999 Genetic and 
Evolutionary Computation Conference, pp. 1504-1510, 1999) by 
20 Cvetkovic et al . , the incorporation of fuzzy preferences 
before optimization can be realized in two ways: 

- Weighted Sum: Use of the preferences as a priori knowledge 
to determine the weight for each objective, then direct 

25 application of the weights to sum up the objectives to a 
scalar. In this case, only one solution will be obtained. 

- Weighted Pareto Method: The non-fuzzy weight is used to 
define a weighted Pareto non-dominance: 

30 

U >_ w V if and only if — £ w i T A u i' ^i) ^ 1 

k i = i 

with the utility sets 



10 
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U := fa I i 
V := {v i | i 



1, 2, 3, . 



1, 2, 3, 



■ • r 



k} for Ui e [0,1] and 
k} for Vi g [0,1], 



5 



where 



v.) 



1 for > v ± 
0 for Uj < v ± 



and X = 1 . 



k 



A general procedure for applying fuzzy preferences to multi- 
10 objective optimization is illustrated in Fig. 2. It can be 
seen that before the preferences can be applied in MOO, they 
have to be converted into crisp weights first. The procedure 
of conversion is described as follows: 

15 Given L experts (with the indices in = 1,2 and their 
preference relation £ rn , where £° is a (kxk) -matrix with p±j 
denoting the linguistic preference of the objective o± over 
the objective Oj (with the indices i,j = l,2,...,/c). Then, 
based on the group decision-making method, they can be 

20 combined into a single collective preference Each element 

of said preference matrix is defined by one of the 
following linguistic terms: 

25 "much more important'' (MMI) , 



For the sake of simplicity, the superscript c indicating the 
collective preference is omitted in the following text. 
Before converting the linguistic terms into real-valued 



"more important" (MI), 
"equally important" (EI) , 
"less important" (LI), and 
"much less important" (MLI) . 



30 



P 26229 EP 

10 

weights, they should at first be converted into numeric 
preferences. To this end, it is necessary to use the 
following evaluations, to replace the linguistic preferences 
Pij in the preference matrix, as indicated in "Use of 
Preferences for GA-based Multi-Objective Optimization" 
(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510) by Cvetkovic et al . 

a is much less important than b => p±j = a, p j± = P, 
a is less important than b => p±j = y, Pj± = 5, 

a is equally important as b => p±j - e, Pj± = e. 

The value of the parameters needs to be assigned by the 
decision-making and the following conditions should be 
satisfied in order not to lose the interpretability of the 
linguistic terms: 

a < y < e = 0.5 < 5 < J3, 
a+p = l= y + 8. 

Consider an MOO problem with six objectives { Oi, Oz, . . . , o 6 } as 
used in "Use of Preferences for GA-based Multi-Objective 
Optimization" (Proceedings of 1999 Genetic and Evolutionary 
Computation Conference, pp. 1504-1510) by Cvetkovic et al. 
Suppose that among these six objectives Oi and o 2 , o 3 and o 4 
are equally important . Thus, there are have four classes of 
objectives: 

ci := {Oi,o 2 }, c 2 := {o 3 ,o 4 }, c 3 := {o 5 } and c 4 := {o 6 }. 
Besides, there are the following preference relations: 

Ci is much more important than c 2 ; 
Ci is more important than c 3 ; 
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c 4 is more important than Ci; 

C3 is much more important than C2. 

From these preferences, it is easy to get the following 
preference matrix: 



P = 



f EI MMI MI LI ^ 
MLI EI MLI ML I 
LI MMI EI LI 



MI MMI MI EI 



From the above fuzzy preference matrix, the following real- 
10 valued preference relation matrix R are obtained: 



f e p 8 y > 
a e a a 

R = 

y P e y 
^ 5 P 8 e j 

15 Based on this relation matrix, the weight for each objective 
can be obtained by: 

Z i = 1 s \Pi, R) 

20 with 

S {o ir r) := £ PiJ . 

1 = 1, 1 * i 

For the above example, this results in 

25 
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w, = w, = 



" 6 



2 - a 



8 + 2a 



w, = w = 



3a 



8 + 2a 



1 - a ± 2V . 
= / ana 

8 + 2a 



3 - a - 2y 
8 + 2a 



Since a and y can vary between 0 and 0.5, one needs to 
heuristically specify a value for a and y (recall that a < y) 
to convert the £\i7.2.y preferences into a single-valued weight 
combination, which can then be applied to a conventional 
10 weighted aggregation to achieve one solution.. 



In order to convert fuzzy preferences into one weight 

combination, it is necessary to specify a value for a and y. 
On the one hand, there are no explicit rules on how to 
15 specify these parameters, on the other hand, a lot of 
information will be lost in this process. 

In view of this disadvantage it is the target of the present 
invention to improve the use of fuzzy preferences for multi- 
20 objective optimization. 

This target is achieved by means of the features of the 
independent claims . The dependent claims develop further the 
central idea of the present invention. 

25 

According to the main aspect of the invention, e.g. fuzzy 
preferences are converted into a weight combination with each 
weight being described by an interval instead of a single 
value . 



30 
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Further objects, advantages and features of the invention 
will become evident for the man skilled in the art when 
reading the following detailed description of the invention 
and by reference to the figures of the enclosed drawings. 

5 

Fig. 1 shows a cycle of an evolution strategy, 

Fig. 2 shows schematically a procedure to apply fuzzy 

preferences in MOO, 
Figs. 3a, 3b show the change of weights {w x and w 2 ) with the 

change of parameter (a) , respectively, and 
Figs. 4a, 4b show the change of weights ( w 3 and w 4 ) with 

the change of parameters (a and y) , 

respectively. 

According to the underlying invention, linguistic fuzzy 
preferences can be converted into a weight combination with 
each weight being described by an interval. 

10 

Figs. 3a, 3b, 4a, 4b show how the value of the parameters 
affects that of the weights. It can be seen from these 
figures that the weights vary a lot when the parameters (a, y 
) change in the allowed range. Thus, each weight obtained 

15 from the fuzzy preferences is an interval on [0,1]. Very 

interestingly, a weight combination in interval values can 
nicely be incorporated into a multi-objective optimization 
with the help of the RWA and DWA, which is explained e.g. in 
"Evolutionary Weighted Aggregation: Why does it Work and 

20* How?" (in: Proceedings of Genetic and Evolutionary 

Computation Conference, pp. 1042-1049, 2001) by Jin et al. 

On the assumption that the maximal and minimal value of a 
weight are w max and w min when the parameters change, the 
25 weights are changed during an optimization algorithm in the 
following form, which is extended from RWA: 
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wi(t) = w« 



+ (wr - 



rdm (p) 
P 



f 



where t is the generation index. Similarly, by extending the 
5 DWA, the weights can also be changed in the following form to 
find out the preferred Pareto solutions: 



10 where t is the generation index. In this way, the 

evolutionary algorithm is able to provide a set of Pareto 
solutions that are reflected by the fuzzy preferences. 
However, it is recalled that DWA is not able to control the 
movement of the individuals if the Pareto front is concave, 

15 therefore, fuzzy preferences incorporation into MOO using DWA 
is applicable to convex Pareto fronts only, whereas the RWA 
method is applicable to both convex and concave fronts. 

To illustrate the underlying invention, some examples on two- 
20 objective optimization using the RWA are presented in the 
following. In the simulations, two different fuzzy 
preferences are considered: 



min 



+ (< ax - < in ) • | sin (2 nt/F) | , 



25 



1. Objective 1 is more important than objective 2; 

2. Objective 1 is less important than objective 2. 



For the first preference, one obtains the following 
preference matrix: 



30 



f 0.5 5 > 

- " I y 0.5 y 
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with 0.5 < 8 < 1 and 0 < y < 0.5. Therefore, the weights for the 
two objectives using the RWA method are: 

wi(t) = 0.5 + 0.5 - £^2, 
wi(t) = 1.0 - wi(t). 

Similarly, the following weights are obtained for the second 
preference: 



10 



w^(t) =0 + 0.5 



rdm (p) 



w 2 J (t) = 1.0 - wi(t) 



To summarize, the invention proposes a method to obtain thej- 
Pareto-optimal solutions that are specified by human 

15 preferences. The main idea is to convert the fuzzy 

preferences into interval-based weights. With the help of the 
RWA and DWA, it is shown to be successful to find the 
preferred solutions on two test functions with a convex 
Pareto front. Compared to the method described in "Use of 

20 Preferences for GA-based Multi-Objective Optimization" 

(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510, 1999) by Cvetkovic et al., the 
method according to the invention is able to find a number of 
solutions instead of only one, given a set of fuzzy 

25 preferences over different objectives. This is consistent 
with the motivation of fuzzy logic. 

Many technical, industrial and business applications are 
possible for evolutionary optimization. Examples for 
30 applications can be found e.g. in "Evolutionary Algorithms in 
Engineering Applications" (Springer-Verlag, 1997) by Dasgupta 
et al . , and "Evolutionary Algorithms in Engineering and 
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Computer Science" (John Wiley and Sons, 1999) by Miettinnen 
et al . 
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* 5 Feb. 2002 

Claims 

1. A method for the optimization of multi-objective problems 
5 using evolutionary algorithms, the method comprising the 

following steps: 

- setting up an initial population as parents (SI), 

- reproducing the parents to create a plurality of offspring 
individuals (S2, S3), 

10 - evaluating the quality of the offspring individuals by 
means of a fitness function (S4), wherein the fitness 
function is composed of the sum of weighted sub- functions 
that represent an objective, 

- selecting the offspring (s) having the highest evaluated 

15 quality value as parents for the next evolution cycle (S5) , 
characterized in that 

during the optimization the weights for the sub-functions are 
. changed dynamically respectively within a predefined interval 
for every weight. 

20 

2. Method according to claim 1, 
characterized in that 

human preferences represented by linguistic preference 
relations are converted into parameterized, real-valued 
25 preferences relations to generate the intervals defining the 
allowed range of weight changes, 

3. Method according to claim 2, 
characterized in that 

30 the parameterized preference relations are converted into 

real-valued intervals by letting the parameters take all the 
allowed value instead of assigning one specific value to each 
parameter. 
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4. Method according to anyone of the preceding claims, 
characterized in that 

the weights for the different objectives are randomly re- 
distributed within the defined intervals among the different 
5 offspring individuals in each generation. 

5. Method according to anyone of claims 1 to 3, 
characterized in that 

the weights for the different objectives are changed 
10 gradually within the defined intervals with the proceeding of 
optimization. 

6. Method according to claim 5, 
characterized in that 

15 the weights are changed within the intervals according to a 
periodic function. 

7. Method according to claim 5 or 6, 
characterized in that 

20 each offspring has the same weight in the same generation. 

8. Method according to anyone of claims 5 to 7, 
characterized in that 

the periodic change has the shape of a sine function applied 
25 on the generation number. 

9. Computer software program product, 
characterized in that 

it implements a method according to anyone of the preceding 
30 claims when run on a computing device. 

10. Use of a method according to anyone of claims 1 to 8 for 
the optimization of aerodynamic or hydrodynamic bodies, 
wherein different objectives have to be taken into account, 
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e.g. pressure loss and outlet angle calculated by a Navier 
Stokes solver and geometric constraints. 
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1 5l Feb. 2002 

Abstract 

A method to obtain the Pareto solutions that are specified by 
human preferences is suggested . The main idea is to convert 
the fuzzy preferences into interval-based weights. With the 
help of the dynamically-weighted aggregation method, it is 
shown to be successful to find the preferred solutions on two 
test functions with a convex Pareto front. Compared to the 
method described in "Use of Preferences for GA-based Multi- 
Objective Optimization" (Proceedings of 1999 Genetic and 
Evolutionary Computation Conference, pp. 1504-1510, 1999) by 
Cvetkovic et al., the method according to the invention is 
able to find a number of solutions instead of only one, given 
a set of fuzzy preferences over different objectives. This is 
consistent with the motivation of fuzzy logic. 
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Algorithm 

t:=0; 

encode and initialize P(0) 
decode and evaluate P(0) 

^recombine P(t) 
mutate P(t) 

decode P(t) 
evaluate P(t) 
P(t+1) = select (P(t) 
encode P(t+1) 
t:=t+1 
until terminate 
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Fig. 3 a 
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Fig. 4b 



